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1. Introduction 

One of the most exciting aspects of single molecule techniques is the possibility of 
accurately measuring tiny amounts of energy down to a tenth of a ksT (at room 
temperature 1 k-^T corresponds to approximately 4 pN-nm which is on the order of 
10"^^ J) [1]. The possibility of measuring such small energies opens new perspectives in 
the exploration of the properties and behavior of biological matter at both cellular and 
molecular levels. Questions such as irreversibility, dissipation and energy fluctuations 
have received a new boost under the heading of nonequilibrium thermodynamics of 
small systems, a discipline that succesfuUy combines theory and experiments and uses 
individual biomolecules as models to investigate the energetics of complex systems [2,3]. 

This paper is a continuation of a companion one where we investigated in 
detail questions related to thermodynamics and kinetics of simple two-state hairpins 
under applied force [4]. Here we investigate issues related to irreversibility and 
dissipation in pulling experiments of DNA hairpins that fold/unfold under the action 
of mechanical force. In these experiments the molecule is repeatedly unfolded/folded 
by increasing/decreasing the force at a given pulling rate in a controlled way. The 
output of such experiments is the force-distance curve (FDC), a diagram that shows the 
force as a function of the trap position. We have carried out experiments (experimental 
setup shown in figure [11(a)) using a high stability newly designed miniaturized dual- 
beam optical tweezers apparatus [5] to pull a specifically designed DNA hairpin 
sequence (figure [11(b)). The specific sequence shows a simple two-state free energy 
landscape, ideal to compare theory and experiments [4]. We use the recently introduced 
theoretical approach of path thermodynamics [3,6] to investigate questions related to the 
irreversibility and energy dissipation in two state systems. The study of DNA hairpins [7] 
has advantages compared to RNA studies because the former degrades much slower than 
RNA does. This makes DNA an excellent model to address physics related questions. 

The content of the paper is divided into two main parts: the first part is 
mainly theoretical and describes the analytical results; the second part presents the 
experimental results and compares them with the theoretical predictions. The paper 
ends with some conclusions followed by a few appendices that include some technical 
aspects of the analytical computations. 

2. Mechanical work, hopping number and free energy landscapes: a short 
reminder 

We consider a pulling cycle (F) consisting of a stretching (S) and a releasing (R) parts. 
In the stretching part the force is increased from a low force /min where the hairpin is 
always folded to a high force /max where the hairpin is always unfolded. In the releasing 
part the force is decreased from /max back to /min- To quantify irreversibility and energy 
dissipation during the stretching and releasing parts of the cycle, we introduce the two 
following quantities: 
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Figure 1. (a) Experimental set up. (b) DNA sequence. 



• The mechanical work IVs(R)- The mechanical work Ws(r) along the stretching 
(releasing) part of the cycle F is the area below the FDC between the positions 
Xjnin and J^max (corresponding to the previously defined forces /min and /max along 
the FDC). It is defined by 

dXFs(R)(X), (1) 

- ^min 

where the subindex S (R) refers to the stretching (releasing) part of the cycle. 
Throughout this work we will take Ws and PVr as positive and negative quantities 
respectively although, according to ([T]), both have positive signs. In fact, the work 
in the S part of the cycle is performed by the instrument on the system {dX > 0) 
whereas in the other case (R) the work is returned by the system to the instrument 
[dX < 0). Figure [2] shows how we measure the work along a given FDC. 

• The hopping number Ms(r). The hopping number Mg(R) along the stretching 
(releasing) part of the cycle F is the number of transitions or jumps (corresponding 
to force rips) that the molecule executes during the stretching (releasing) part of 
the cycle. Ms(r) can take only odd values (1, 3,5,.. .) for all paths F performed 
between /min and /max- An illustration is shown in figure [2l 

These are the main quantities that we will focus on in this paper. Out of the total 
work ty^(^) we can also extract, for each cycle F, the dissipated work VK^/g^^ which is 
equal to the difference between the work and the reversible work. The reversible work 
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Distance X (nm) 

Figure 2. A representative FDC corresponding to either a stretcliing or releasing 
part of a cycle. It shows the relevant quantitites that we investigate: the mechanical 
work exerted on the molecule M^s(R) (shown as the dotted area); and the nmnber of 
transitions the molecule executes between the two states, Mg(pj) ( = 3 in the example 
of the figure). 



can be estimated either using the Jarzynski equahty along the S (R) process [8] or the 
Crooks fluctuation relation [9, 10]. The latter combines measurements from both the S 
and R processes and provides better estimates for free energy differences. The Crooks 
fluctuation relation has been applied to recover the free energy of the DNA sequence 
shown in figure [U^b) (see our companion paper [4]). 

The mechanical folding and unfolding of small nucleic acid (DNA or RNA) hairpins 
is commonly described with a two-state model [11-15]. In this model the hairpin can 
adopt two conformation or states, the folded (hereafter referred as F) and the unfolded 
or stretched (hereafter referred as UF) state. When subject to force, the projection 
X of the molecular extension along the force axis is an adequate reaction coordinate 
for the folding-unfolding reaction. For a given applied force /, the two-state approach 
considers a single-kinetic pathway for the unfolding/folding reactions and the free energy 
landscape is characterized by a single transition state (hereafter referred as TS). The TS 
is the state with highest free energy along the reaction coordinate and determines the 
kinetics of the unfolding (folding) reaction. The simplest version of the Kramers-Bell 
model (see [4] for details) is schematically depicted in figure [3]^a). It involves only four 
parameters: the free energy difference AGi the kinetic barrier Bi and the distances 
and x^^ along the reaction coordinate axis that separates the TS from the F and UF 
states respectively. The total distance between the F and U states will be denoted as 
Xm and can be written as x^ = + x^^. 
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Figure 3. (Upper panel) Schematic picture of the two-state model. Tlic free 
energy landscape of the molecule along the reaction coordinate axis x has two minima 
corresponding to the F and UF states. These states have free energies Gf and Guf 
with AG = Guf — Gf- The two states (F and UF) are separated by the transition 
state (TS) that has a free energy B higher than that of the F state. The TS is located 
at distances and x^^ from the F and UF states respectively. When a mechanical 
force is applied to the ends of the molecule the free energy landscape is tilted along 
X, decreasing the free energy of the UF state and the TS relative to the F state. This 
induces a variation of B and AG which, in the simplified Kramers-Bell picture are 
given by _B = _Bi — fx^; AG = AGi — fx„^ where Bi, AGi are constant free energy 
parameters. (Lower panel) Free energy landscape G{x, /) for the DNA hairpin shown 
in figure [Ijb) plotted as a function of the number of open base pairs at / = 17.9 pN 
(buffer conditions are IM NaCl and 23° C). The landscape has been calculated using 
the nearest neighbour model [16] for thermodynamics using the free energy parameters 
given by Mfold [17] and the theory developed in [4]. 
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Two-state folders are well described by the so-called simplified Kramers-Bell kinetic 
rates, 

k^if) = k^exp , k^if) = k^exp (/3(AGi - /a;^^)) , (2) 

with f3 = l/ksT, T being the temperature of the environment and k^ the Boltzmann 
constant, k^ corresponds to the unfolding rate at zero force and is given by /cm = 
fco exp — where ko is an attempt frequency describing microscopic oscillations and 

effects of the experimental setup (bead motion, fluctuations in extension of handles and 
ssDNA), and Bi is the kinetic barrier. The parameter AGi in ([2]) is related to the total 
free energy difference between the F and UF states at force /: AG{f) = AGi — fx^. 
AGi gets contributions from the free energy of formation of the hairpin at zero force, 
AGq, and the free energy of stretching the ssDNA up to the total extension 
(= + x^^) at force /. 

Equation ([2]) defines the coexistence force fc where both rates are equal, k^{fc) = 
k^{fc), giving fc = AGi/xra- All parameters entering into the simplified rates ([2]) (i.e. 
kra, x^ , x^^ , AG) are taken to be independent of force and AGi is evaluated at the 
critical force fc (see [4] for a thorough discussion). 

The distances x^ , x^^ characterize how much the molecule deforms before unfolding. 
It is common to define the fragility parameter n [18-21]: 

F UF 

/i = -pr- TfiT . (3) 

X^ + 

/i lies in the range [—1 : 1] and defines the degree of compliance of the molecule under 
the effect of tension. Fragile or compliant molecules are those in which x^ is larger than 
x^^ and fi is positive. In contrast, when x^^ is larger than x^ and fi is negative we 
speak of brittle structures. 

3. Mechanical work and hopping number in path thermodynamics 

In this section we apply path thermodynamics [3] to find analytical expressions for the 
average dissipated work and the average hopping number in two-state systems. These 
are later compared with our experimental results obtained in DNA hairpins. The general 
reader not interested in the mathematical details of the derivation can skip section 13.11 

3.1. Derivation of the equations. 

Let us consider a schematic version of our two-state system represented by a discrete spin 
variable a that labels the state of the system, cr = — 1, 1. The spin a can switch between 
states of zero free energy [a = —1) and free energy AG (a = 1). The Hamiltonian of 
the system can be written as: 

ffM = AG<^. (4) 

In the presence of an external field / the Hamiltonian has a new term and is given by: 

ffM = AG(^-W^. (5) 
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where Xm is the couphng between the system and the external field. For the case of the 
folding-unfolding reaction under force /, the two states, a = —1,1, correspond to the 
folded (F) and the unfolded (UF) states respectively, and Xm is the molecular distance 
separating them along the reaction coordinate axis, i.e. = + (see figure [3]). 

We consider an isothermal perturbation where the external field is changed from 
an initial value /min to a final one /max following a given protocol f{t), denoted as 
a ramping protocol. In this protocol the force is externally controlled and does not 
fiuctuate. The equilibrium and thermodynamic properties that are computed when the 
force is controlled correspond to the so-called force ensemble. 

According to the formalism of path thermodynamics introduced in [6] , we consider 
a system composed of independent two-state particles with dynamical evolution 
governed by the Hamiltonian in (JSj). A path or trajectory F of the system is defined by 
the sequence of configurations Ck, F = {Ck, 1 < k < Ag} with Ck = {af, 1 < i < A^}, 
the index k denoting a time equal to kAt where the total time ttotai has been discretized 
in A's steps of duration At = ttotai/Ag- The work W per particle along a single path F 
reads: 

W{T) = -^ Y: m^^\f^^^ - f^) , (6) 

^ fc=0 

where m!' = Y^f=i o"f and f'' are the values of the magnetization and external field at 
time k. The factor 1/2 in ([6]) arises from the absolute value of the change in extension 
associated to the transition a —a, A{x^a /2) = x^. On the other hand, the hopping 
number M per particle over a single path reads: 

^(r) = T7 E E^(i-^M^')- (7) 

The distribution of probability Pn{0) for any observable 9 (e.g. W or M) measured 
over all paths can be written as: 

PN{e)=Y.Sid-9{TmT). (8) 
{r} 

Assuming that the dynamics is Markovian, P(F) is given by: 



P(F) 



-,k(k+l I k\ 



N 



n^>o(o, (9) 



fe=0 1 = 1 J 4 = 1 



where q {a' \ a) is the transition probability to go from a to a' at time k and po is the 
initial equilibrium distribution. The details for the computation of the average work 
and hopping number are presented in Appendix A Here, we outline the main steps of 



the computation and give the final results. 

Following [6], we use the integral representation of the delta function and write 
the distribution of work and hopping number as: Pn{W) = J d{r}e^'"' and Pn{M) = 
J d{F}e^ '', where a and b are functions defined over the space of trajectories {F}. In 
the thermodynamic limit (A^ oo) the problem can be solved by applying the saddle 
point technique, i.e. maximizing the functions a and b with respect to their phase-space 
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variables. From the saddle point equations we obtain closed expressions for the average 
quantities, (...), where the brackets represent an average over an infinite number of 
realizations of the ramping protocol. In the continuous time limit, corresponding to 
At — i> 0, A^s — s> oo and At ■ Ng = t, the average total work, {W), the average dissipated 



work, (IVdis), and the average hopping number, (M), are given by (see [Appendix A] ): 

Xrv, /"/max 

(W) =-^i rnif)df, (10) 
{W^is) = {W) - iy,ev = f^^^\rn{f) - m^MW , (H) 

(M) =^ f^^\m{f)kuU) + Mfm/rif)W. (12) 

where W^c^ is equal to the reversible work, i.e. the work measured in the quasi- 
static limit. k^{f) and k^{f) are the kinetic rates corresponding to the transitions 
0" = — 1 — ^ 1 and from a = 1 — — 1 respectively. kT^if), kuif) are defined as 
krif) = k^if) + k^if), kuif) = k^if) - k^if). The functions m,^{f) and m(/) 
are given by: 

».(/)^|^. (13) 

and 

m{f) = m^^{f)- — — exp - / — — cZ/a d/i , 14 

where r is the loading rate defined as r = 

3.2. Constant loading rate 

From now on we consider the case in which the force / is varied from /min to /max at 
a constant loading rate r. The initial and final values of the force, /min and /max, are 
such that the equilibrium probabilities to be in the F state [a = —1) are equal 1 and 
respectively, i.e. meq(/min) = —1 and mcq(/max) = 1- Note that such condition is 
always experimentally verified along the stretching process where initially the molecule 
is always folded and finally unfolded at the end of the process. 

Interestingly, when the dynamics is governed by the rates in ([2]), {Wdis)/kBT and 
(M) become functions of only two adimensional parameters, the fragility fi and an 
adimensional rate f: 

(W^dis) _ r r ^y^_^^^fl_ r dze'^'coshz] , (15) 
'-00 cosr » > - ' 

roo 



kBT J-oo J-oD cosh y \ r 

/oo 
dx(l — tanh^ x)e^^ coshx 
-oo 

(16) 



/OO rx / 1 /"^ 

dxe^^sinhx / dy 2~6xp(— - / d^e'^^cosh^ 
-oo J-oo cosh y \ f Jy 

The fragility /i has been defined in (|3]) whereas the adimensional rate f is given by 
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kc being the folding-unfolding rate at the coexistence force value at which the F 
and UF states are equally populated, kc = k^{fc) = k^{fc) . Equation f|T5l) is the 
equivalent of equation (49) in [6] obtained for the Glauber kinetics of a magnetic dipole 
in a magnetic field. 

Since our goal is to identify relations between measurable quantities and 
the parameters characterizing the molecule, we have investigated the loading rate 
dependence of (M) and (VTdis)- In figure H] we show the average dissipated work and the 
average hopping number as a function of the adimensional rate f for different fragilities 
/i obtained by numerical integrating (fT5l) and (fT6!) . 

3. 3. The stretching versus the releasing processes 

Let us consider a symmetric protocol, i.e. in the stretching process the force / increases 
from /min to /max at a loading rate r, while in the releasing process / decreases from 
/max to /min at the Same rate. According to ( fT5i) and ( fT6|) (Wdis) and (M) are sole 
functions of f, /i. The transformation from the stretching to the releasing force protocol 
(stretching/release transformation) corresponds to the exchange ^ x^^ implying 
^ — *• — yU in f|T5|) and f|T6|l . Moreover, since r and change sign under the stretch/release 
transformation, the parameter f is invariant under such transformation. For a given 
value of f we can write 

(W^dis)s(/u) = (W^dis)R(-/i) , (M)s(/i) = (M)R(-/i) . (18) 

Moreover it is easy to prove that the average hopping number (M) (fT6l) is invariant 
under the transformation /i — > — /i, whereas the average dissipated work (VFdis) fflSj) is 
not. (M)(/i) verifies: 

(M)(/i) ^ (M)s(/i) = (M)s(-/i) = (M)R(-/i) = (M)r(^) . (19) 

This is a symmetry relation that can be checked in simulations and experiments. Results 
for (Wdis) and (M) for different values of /i are shown in the top panels of figure HI 

In [22] (see the section Fraction of trajectories that have at least one refolding and 
the Appendix C) it was proven that the average fraction (p of trajectories (a quantity 
different from M) with more than one unfolding (refolding) (i.e. with M > 3) is 
equal along the stretching and release processes for a symmetric perturbation protocol. 
Although we have been unable to compute such quantity </> using path thermodynamics 
it is interesting to see that the same symmetry relation ([T9|) is also satisfied by the 
average hopping number (M). 

In the numerical simulations done in [22] (see figure 11 in that reference) it was also 
shown that the fraction 0, when plotted as a function of the average dissipated work 
along the stretching process, (PVdis)s5 collapse into a single curve for different two-state 
systems (i.e. that are characterized by different values of the parameters AG, x^, x^^ 
and fcm). Although we cannot verify or falsify such relation for 0, we can see that (fT9l) 
precludes the validity of a similar relation for (M). As shown in the bottom left panel 
in figure m the relation between {W^is)s and (M) is not unique for different values of 



Dynamic force spectroscopy of DNA hairpins. II. 



10 



(otherwise (Wdis)s(/^) would be identical to (Wdis)R(/i), which we know it is not generally 
true). 

By applying ( |T5l) to the stretching and releasing processes it is possible to isolate the 
variable f and express (Wdis)s as a function of (Wdis)R and the fragility fi. By plotting 
(W^dis)s as a function of ( Wdis)R for different values of we can get isofragility curves that 
characterize the dissipation of the molecule along the stretching and releasing processes. 
The results are shown in the bottom right panel of figure HI The relation between the 
dissipated work measured in the stretching and releasing processes can be then used to 
obtain information about /i, and hence about the TS of the folding/unfolding reaction. 



3.4- Low loading rate regime 

Equations f|T5l) and f|T6l) are not analytically integrable, however we can solve them 
numerically as well as study their asymptotic behaviour in the low loading rate regime. 
The low loading rate regime is investigated by expanding the expressions for (VFdis)/^B^ 
and (M), (fT5!l and (fT6l) . around f = 0. The analytical computation of the different terms 
of the expansion is presented in Appendix B We report the final result : 

= ~ /^^) sec(7r^/2)f - '^^^{1 - fi^)TT csc{iT^)r^ + 
k-B-L 2 3 

+ ^(-5 + 51/1^ - 55;u^ + +9/i^)7r sec(37r^/2)f=^ + O(f^) , (20) 

(M) = (7r/2)sec(7r/i/2)^ + ^(9 - lO/i^ + /)7r sec(7r/i/2)f 

- -(/i - /i3)7rcsc(7r/i)f2 + 0(f3) . (21) 
3 

The first term in the expansion of (Wdis) agrees with the linear response result previously 
reported in [23] for the case fi =— —1 (i.e. 0, corresponding to an unfolding rate 

independent of force). For that case we get 

^ = 2f + 0(r~2) (22) 

(M) ^ oo , (23) 

whereas for the case /i = (corresponding to a TS located in the middle between the F 
and UF states) we get 

^4.^ + 0,.^) (24) 

(M) = ^ + 0(r~) . (25) 

In figure H] (top panels) we plot (black dashed lines) the expansion (124|) (figure HJ top 
left panel) and the expansion (figure SJ top right panel) for the case /x = 0. 



4. Dissipation in the mixed ensemble 

In the previous analysis we considered that the force is externally controlled and does not 
fluctuate (force ensemble). However in the optical tweezers experiments this is not the 



Dynamic force spectroscopy of DNA hairpins. II. 



11 




Figure 4. Various plots of (Wdis) (in ksT units) and (M) as a function of the 
adimensional loading rate r obtained by numerical integrating p5|l and ()16p for various 
values of /i (indicated in the panels). (Top left) (VKdis}s along the stretching process 
as a function of f. (Top right) (M) = {Mp) = (-^^-r) as a function of f for both the 
stretching and releasing processes. The dashed line corresponds to the expansion 
for /i = 0. (Bottom left) (M) as a function of (Wdis}s along the stretching process. 
(Bottom right) (Wdis}s as a function of (VFdis}R- Note that (Wdis)s < (M^dis)R for 
/i > 0, (Wdis)s > (VFdis)R for < whereas for /i = (TS located in the middle of the 
two states) (lydis)s = (W^dis)R- 



case because it is the position of the optical trap relative to the pipette (rather than the 
force) that is controlled. This corresponds to what has been called the mixed ensemble 
(see our companion paper [4]). The kinetic rates measured in the mixed ensemble are 
different that those measured in the force ensemble [22,24-27]. This is a consequence of 
the extrem sensitivity of the kinetic rates on height of the kinetic barrier (through the 
Arrhenius exponential dependence). Just a | kcal/mol variation at room temperature 
in the value of the kinetic barrier can modify the rates by a factor of 2 (100%). Because 
the value of the kinetic rate kc enters into the the definition of the adimensional rate 
f ( fTTI) . a 100% variation in its value will invalidate an adequate comparison between 
theory and experiment. The influence of the ensemble on the kinetics is yet another 
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cr = l (UF) 
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X = x + X 



m 



Figure 5. Schematic picture of a simple model for the mixed ensemble. (Left) Folded 
state (7 = 0. (Right) Unfolded state a — \. See main text for the explanation of the 
different parameters. 



example of nonequilibrium thermodynamics applied to small systems [2], i.e. about how 
nonequilibrium effects strongly depend on which experimental variables are controlled 
when the size of the system is small enough. 

In the current theory the dissipated work and the average hopping number were 
obtained in the force ensemble. A path thermodynamics calculation for the mixed 
ensemble seems too tedious for the same analysis to be repeated again. In what follows 
we show that it is possible to carry over the theory in the mixed ensemble into the 
force-ensemble theory developed in section [3] just by appropriate rescaling of the kinetic 
rates (jSj) by a rescaling factor Vt. This rescaling only affects the value of the critical rate 
fee that enters into the definition of f (ITTl) whereas the rest of parameters (such as 
and /x) remain unchanged. 

4.1. A simple model for the mixed ensemble 

Let us consider the system formed by a single hairpin in series with a Hookean spring 
(figure [5]). The spring has stiffness equal to fcx whereas the molecule can be in two states, 
0" = (folded) and cr = 1 (unfolded). This Hookean spring stands for the combined 
effect of the bead in the optical trap and the handles used to manipulate the hairpin. 
The total extension of the system is 



where x is the extension of the spring and Xm is the molecular extension of the unfolded 
molecule. We will assume that x^ is not force dependent and we will take a zero 
extension for the folded molecule. 

In the mixed-ensemble protocol the total distance A (equal to the distance between 
the optical trap and the micropipette) is controlled. The total energy of the system can 



\ = X + x^a , 



(26) 
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be expressed as 

E{\, a) = h,{X - x,^af + a AG , (27) 

where AG is the free energy difference between the unfolded and the folded states of 
the hairpin. The force- distance curve (FDC) is given by 

/.(A) = = K{X - x^a) = Kx . (28) 

OA 

The FDC of the system has two branches depending on whether the molecule is folded 
or unfolded. If the molecule is folded (cr = 0) we have 

A(A) = 5^ = M. (29) 

whereas in the other case, 

/uf(A) = = - Xra) , (30) 

i.e both force- distance curves have the same slope [k^), but there is a drop in the force 
equal to k^x^ when the molecule unfolds. Note that this is exactly what is observed in 
the force-extension curves shown in figure [2l 

What is the appropriate theory for the dissipated work in the mixed ensemble where 
the total distance (A) rather than the force (/) is controlled? In principle we should 
expect work fluctuations to differ in both ensembles. The mechanical work along a 
trajectory T in the force and mixed ensemble, Wf and Wx respectively, is given by 

//max 
adf, (31) 
J mill 

W,{T)= fdX. (32) 

/min, /max (Amin, A^ax) the initial and final values of the force (total distance), the 
trajectory F is defined by the time evolution of {a{t)}, and 

Integrating by parts W\ and using the relations fl28|) and fl26|) . we get 

W6v(F) = [/(Amax)Amax — /(Amm)Amin] ~ 

In on /"/(Amax) 

7^[/'(Amax)' - /'(Amin)) - Xm / Cldf = 

= W/(F) + (/maxAmax " /minAmin) - ^(/max ~ /min) 5 (34) 

where in the last line we have taken the instantaneous forces in the mixed ensemble 
equal to their values in the force ensemble, fmm = /(Amin)5/max = /(Amax)- Although 
work distributions are expected to differ in both ensembles, differences in the average 
dissipated work are expected to be negligible. Therefore, (Wf^****(F)) = (PFj^'^'^(F)) with 
VFdi««(r) = Wx{T) - ^, ^^(F) = Wf{T) - Wf". If the average dissipated work is 
the same in both ensembles then where is the expected difference between the measured 
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dissipated work in the two experimental conditions (controlled / versus controlled A)?. 
The answer is in the kinetics. Because the kinetic rates in both ensembles are different, 
the ensemble of paths F generated in both ensembles have different work and dissipated 
work distributions. 



4-2. Resettling factor for the kinetic rates 

Let us define K^{\), K^{X) as the rates in the mixed ensemble (we use major case 
letters to distinguish them from the force-ensemble rates). The mixed-ensemble rates 
must satisfy the detailed balance condition, 

= exp {-^{E{X, 1) - E{X, 0))) . (35) 

Inserting the expression for the energy (1271) we get 



= exp [-(3{IU{X - - X') + AG)) 



(36) 



We can now express the difference of the squared terms in (136!) as a product of a sum 
times a difference of two terms. However, according to the FDCs for the two branches 
fl29|) and fl30|) . the factor 1/2 times the sum is just the A-dependent average force / 
between the two branches, 

7(A) = ^(/f(A) + /uf(A)) = ^A:.(2A - x^) . (37) 



Therefore, 



exp[-/5(-/x„ + AG')]. (38) 



where we parametrize the rates in the mixed ensemble K^{X), K^{X) in terms of / 
rather than A. Because these rates must satisfy detailed balance (!38l) we can write 

K^iJ) = k^iJ + a) , (39) 
K^(f) = k^(f + b), (40) 

where k^, k^ are the kinetic rates ([2]) and a, b are two arbitrary functions of / (i.e. of 
A). Using the definitions ([2j) and inserting them in (138|) . we obtain the identity 

ax^ + bx^^ = . (41) 

There is an infinite number of possible solutions that satisfy this equation. The most 
general solution is 

a = Cx^^ , b = -Cx^ , (42) 

with C an arbitrary function of A. We now express a, b in terms of the fragility fi defined 
in ([3]). It is straightforward to verify that 

X — , X — Xjji (43) 
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where we used f l33p . We now introduce the difference A/ between the forces along the 
F and UF branches at a given value of A, 

A/ = /f(A)-/uf(A) = A:.x^. (44) 

Note that in this simple model A/ is independent of A (incidentally, let us note that 
the difference of force between the two branches shown in figure |2] is approximately 
constant). Inserting fHSl) and (jHj) into fH2l) . we get 

a = a(l-/i)A/, 6= -a(l +/i)A/, (45) 

where a is a dimensionless constant. Substituting (145|1 into (139|) and (l40l) . we finally 
obtain 

K_U) = k^{f + a{l-^i)Af) , (46) 

i^^(7) = A:^(7-a(l + ^)A/) , (47) 

where a remains undetermined. 

We cannot proceed further unless we introduce a microscopic model for the 
folding/unfolding of the hairpin in the proper experimental setup. This was done in [22] 
where Kramers theory was applied to investigate thermodynamic and kinetic aspects 
of RNA hairpins in the mixed ensemble relevant to pulling experiments using optical 
tweezers. The expression for the kinetic rates were obtained in formulae (B5), (B6) in 
the Appendix B of that reference. These satisfy ( l46l) and ( 147|) with a = 1/4. If we 
insert a = 1/4 in (146!) and (147|) and use ([2]), we get 

K_,{f) = k^U) exp (^/^ii^x^A/^ , (48) 
K^U) = k^(f) exp ( p^l±J^x''^Af] . (49) 



Now we use again (1431) to obtain 

k^iJ) = nK^iJ) , (50) 

k^iJ) = nK^iJ) , (51) 

where f2 is a rescaling factor for the kinetic rates defined as 



fl = exp 



2 



- f f3^-^x^Af 



(52) 



showing that both rates K^, must be rescaled with the same factor Vt. 



4.3. The critical rate in the mixed ensemble, kc. 

We can now extend the theory developed for the force ensemble to the mixed ensemble. 
Instead of the simplified rates ([2]) we must use the rescaled rates (1501) and fl5T]) . 
Consequently, all the results obtained in section [3] hold but by using the rates fl50l) 
and (EI]) instead of 

The value of the rates K^{f), K^{f) in the mixed ensemble can be measured 
in hopping experiments in the passive mode [26,27]. In these experiments the total 
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extension A was held fixed and the evolution of the force is recorded. A typical passive 
mode force trajectory shows a square-like signal in which the force jumps between two 
values (see below in Figure E]) , the high value /f corresponding to the F state and 
the low one /uf corresponding to the UF state. Two types of representation for the 
passive rates were adopted in these references. In one representation rates are plotted as 
functions of / (or A). These were called apparent rates, K^'P{f), K^'^i^f), to distinguish 
them from plain passive rates where the relevant variable is the force corresponding to 
the folded or unfolded branches, /f, /uf, K^^'^'ifp), K^^'^'ifup)- The rates K^,K^ 
introduced in the previous section correspond to the apparent rates measured in passive 
hopping. 

The value of the coexistence rate kc that must be used in the definition of f in f|T7j) 
is given by 

K = k^iJc) = k^Uc) (53) 
and using the results ( l50l) and (l5Ti) we have 

fcc = ^^i^^^ (54) 

where J^^pp is the critical apparent rate in the mixed ensemble defined as 

^app ^ i^appgj ^ irtPP(7j , (55) 

where from (06]), (gT]) and ^ we obtain J^ = f^ = AGi/x,^. 

By plotting the passive apparent rates as a function of / we can determine K^^^ 
as the value of the rate at which K'^^lf) and -ft'^P(/) intersect each other. The plain 
and the apparent rates satisfy 

i^T(7) = ^^^'°(7+^), (56) 

K^P(J) = Kt^-^g - ^) , (57) 



and from (ISO]) and flHT]) we obtain 



k^[f) = nKt^'^[f + ^)^ (58) 

k^g) = nKt^'^U-^). (59) 

(60) 

Finally, it is easy to verify that i^P^*^™ = K^^^Vl? and from we get 

r^plain 

E = (61) 

Because ^2 < 1 we have the following chain of inequalities: 

Kf'^'' <\< A;^pp . (62) 

Note that all these three rates are defined in the mixed ensemble and cannot be directly 
compared to experimental rates measured in hopping experiments carried out in the 
constant force mode (i.e. in the force ensemble). The value of critical rate measured in 
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Table 1. Collected statistics from pulling data. The parameteres are: v (pulling 
speed in nm/s); r (loading rate in pN/s); A'm (total number of molecules); A^s (total 
number of stretchings); A'r (total number of releasings); (Wdis)s (average dissipated 
work along the stretching process in ksT units); (Wdis)R (average dissipated work 
along the releasing process in k^T units); (A/)s (average hopping number along the 
stretching process); (M)r (average hopping number along the releasing process). The 
experimental errors are shown in parenthesis and give an estimate of the variability 
among different molecules. (*) For the slowest pulls (25 nm/s) we have data for just 
one molecule so we do not indicate the experimental error. 
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hopping experiments in the constant force mode (what we called in section [2] and is 
used in (fT5|) and (fT6|) ) should be compared to pulling measurements of (Wdiss) and (M) 
done in the force ensemble, where the force acting on the bead (rather than the position 
of the trap) is controlled and ramped at a constant rate. 

5. Experimental results 

In this section we compare the experimental results for (IVdis) and (M) that we obtained 
in pulling experiments for the DNA hairpin of figure [l](b) with the theoretical predictions 
developed in the preceding sections. Important parameters to compare theory and 
experiments are: the distances and x^^, necessary to determine the fragility fi ([3]), 
and the coexistence rate, kc, necessary to determine the adimensional rate (fT7|) . A 
detailed characterization of the kinetics of a hairpin can be done with pulling or hopping 
experiments. In our companion paper [4] we investigated in detail the folding/unfolding 
kinetics of the hairpin using pulling experiments. However, accurate estimates for kc 
are easier to obtain in hopping experiments. As we explained in section IT3] the hopping 
experiments should be carried out in the passive mode [26,27]. All experiments were 
done at a temperature 23° — 24° C in a IM NaCl aqueous buffer with neutral pH (7.5) 
stabilized by Tris HCl and IM EDTA. 

5.1. Passive hopping experiments 

Hopping experiments are useful to directly test the validity of the Kramers-Bell 
simplified kinetic rates ([2]) and extract kinetic parameters such as the coexistence rate kc 
and the distances between the TS and the F and U states, x^ and x^^. A typical hopping 
trace is shown in figure [6] (left panel). In the passive mode the trap is in a fixed position 
and the force switches between two values as the molecule executes transitions between 
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the F and the UF states [26,27]. A typical histogram of the forces is shown in figure E] 
(right panel). By fitting the histograms to Gaussians, we can determine the average 
force in the F and UF states, /f, /uf, and the average force / = (/f + /uf)/2 for each 
passive mode configuration. From the dichotomic traces shown in figure [6^ we can also 
measure the residence times in the F and UF states for each trap position, Tp{f), ruF(/)- 
By averaging ((...)) the residence times we can extract the passive apparent rates, 

(^f(/)) (^uf(/)) 
The resulting rates are shown in figure [71 Linear fits to the logarithm of the rates give 
the following distances: = 10.2 nm, a;^^ = 8.7 nm. For the coexistence rate we 
obtain /T^pp = 2.3 Hz with ~ 17.1 pN giving Xm = 18.9 nm and /i = 0.1. We also get 
AG* = 78 ksT {k-QT = 4.11 pN ■ nm). These values are compatible with those reported 
from rupture force kinetic studies in [4]. 

The critical rate kc can then be extracted from the measured value for the passive 
rate K^^^ through (IMI) and the rescaling factor (15^ . To evaluate Vt we need to introduce 
the value for A/ = /f — /uf — 1.1 pN and k-oT = 4.11 pN-nm. Substituting these 
numbers into ( l52l) and ( l54l) . we get 

fi = 0.54, I?c = l-4Hz. (64) 

Note that from we can also extract the value of Kf'^''^. We obtain Kf""^^ = 0.74. 
As expected this agrees with the value of the critical rate found in the representation 
where rates are plotted as functions of the average force in the folded and unfolded state 
(data not shown). Finally, the value for K^^'^^'^ is not far from the value 0.58(1) reported 
from rupture force kinetic studies (see table 1 in [4]). 



5.2. Pulling experiments: results for (Wdis) and (M) 

To evaluate the average dissipated work and the average hopping number we have carried 
out pulling experiments on the sequence shown in figure Wljo) at five different pulling 
speeds (corresponding to five different loading rates ranging from 1 to 16 pN/s). A 
summary of the collected statistics and the results obtained for each molecule is shown 
in table [H 

By measuring the mechanical work and the hopping number along the 
stretching/releasing parts of each force cycle we have obtained the average total work 
and the average hopping number for each set of data. Finally, the average dissipated 
work for each molecule has been measured substracting the estimated reversible work 
to the average total work (how we estimated the reversible work is explained in our 
companion paper [4]). 

In order to compare theory and experiments we take the following values obtained 
from the hopping experiments previously discussed in section 15.11 = 19 nm, 
ksT = 4.11 pN-nm, /i = 0.1, K = 1.4 Hz. 

In figure [8], figure [9l figure [TOl figure [11] we show various plots of the average 
dissipated work and the average hopping number at five pulling speeds. The experimental 
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Figure 6. Hopping experiments in the passive mode. (Upper panel). A 
typical tiopping trace measured at tiiree trap positions: upper (higli forces), middle 
(intermediate forces) and bottom (lower forces). (Lower panel) Force distributions for 
the dichotomic signal shown in the upper panel. 



results for the dissipated work are in agreement with the theory over a wide range of 
puUing speeds (figure [8]). Moreover, the symmetry relation flT9|l seems reasonably well 
satisfied by the experimental data. The dependence of (M) on the loading rate is well 
reproduced by the theory (figure [9]). The agreement is specially good in the right panel 
of figure figure [9] where the asymptotic large r region where (M) — > 1 has been expanded 
by plotting (M) — 1 in logarithmic scale as a function of the loading rate r. 

Finally, in figure [TO] we plot the average dissipated work as a function of the average 
hopping number whereas in figure [TT] we plot the average dissipated work along the 
stretching process as a function of the average dissipated work along the release process. 
The plots shown in figure and figure [TT] have in common that depend on the value 
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Figure 7. Determination of the critical rate in the passive mode. Rates in the passive 
mode as a function of the average force /. The dashed hnes are fits to the simphfied 
rates A least squares fit to the data gives = 10.2 nm, a;^^ = 8.7 nm, /i = 
0.1, iff'PP = 2.5 Hz. Data have been obtained for 3 molecules. 



of jj, but not on kc- Therefore, just by measuring (PVdis) and (M) along the stretching 
and releasing processes we might be able to easily identify the value of the fragility of 
the molecule. The strong dispersion observed in the different isofragility lines shown in 
figure m (left bottom panel) together with the unavoidable experimental errors in the 
data (see figure [10]), preclude the use of a plot (M) vs. (VFdis)s to infer the value of 
/i. More convenient is the plot of (VFdis)s vs. (Wdis)R where the isofragility lines change 
monotonically with fi (see figure HI right bottom panel) making easier to extract the 
value of /i from the experimental data (figure [TTIl . 

6. Conclusions 

We have investigated irreversibility and dissipation effects in molecules that fold/unfold 
in a two state manner under the action of mechanical force. We have developed a general 
theory for two state molecules capable of predicting the average dissipated work and 
the average hopping number as a function of the loading rate and other parameters 
that describe the geometrical features of the free energy landscape of the molecule. The 
average dissipated work and the average hopping number are shown to depend on only 
two parameters: the fragility /i (which characterizes how brittle and compliant is the 
molecular structure) and the coexistence rate fee (measured at the coexistence force 
where the free energies of the folded and the unfolded states are equal). These two 
parameters can be experimentally measured in hopping experiments. We have tested 
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Figure 8. (Wdis) for the stretching (circles) and releasing process (squares) plotted 
as a function of the loading rate. The continuous (dashed) lines are the analytical 
predictions (fT5|) for the stretching (releasing) processes. The straight dotted line is the 
linear response regime (j20p . 
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Figure 9. The average hopping number (A/) for the stretching (circles) and releasing 
(squares) processes as a function of the loading rate. The continuous line is the 
analytical prediction for the stretching and releasing processes that satisfy the 
symmetry relation p^ . (Left panel) (M) in normal scale. (Right panel) To better 
appreciate the agreement between theory and experiments we plot the quantity (M) — 1 
in logarithmic scale. 
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Figure 11. The average dissipated work (Wdis)s as a function of (W^dis}R- The 
straight line corresponds to the case ^ = that separates fragile and compliant 
behavior. 
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the theory by carrying out pulhng experiments on DNA hairpins using optical tweezers. 
We remark two interesting results of the present work: 

• Rescaling of the kinetic rates. We showed that in pulling experiments where 
the cantilever or the trap is moved at a constant pulling rate, the hopping rates 
measured from passive mode hopping experiments must be rescaled in order to 
account for the appropriate experimental conditions. The derivation of the rescaling 
factor Q ( l52l) shows the influence of the experimental setup to quantify ireversibility 
effects in small systems. In general, an accurate knowledge of the kinetic rates is 
not necessary in single molecule studies (often, knowing the order of magnitude of 
the kinetic rate is enough). However, in our work it is necessary to determine the 
kinetic rates with high accuracy (let us say within 10%) in order to get an adequate 
comparison between theory and experiments. The rescaling factor Q, albeit of order 
one, introduces an important correction that makes theory predictive in pulling 
experiments where the force is not controlled (e.g. in optical tweezers or AFM 
experiments) . 

• Symmetry property of hopping number. The symmetry property for the 
average hopping number (|T9|) appears as an interesting non-trivial consequence of 
the detailed balance property. We can define the distributions Ps{R){M) for the 
fraction of trajectories with M transitions, (M) being just the first moment of 
the distributions. Is such distribution identical for the stretching and releasing 
processes, ps{M) = pr(M)? A more elaborated theory, in the lines of the work 
recently developed by Chvosta and collaborators [28], might provide the answer 
to this question. Also it is interesting to speculate whether such a result holds in 
general reaction pathways beyond the two-state approximation. 

The agreement found between theorectical predictions and experiments in DNA 
hairpins validates our theory and shows how this can be applied to infer kinetic 
information of the molecule under study. In general, the current theortical results 
should be valid for RNAs and proteins as well. However many biomolecules do not 
fold into a two-state manner so the current theory should not be applicable to systems 
characterized by complex free energy landscapes such as molecules with more than 
two states (e.g. molecules with intermediates or misfolded states) or even in two-state 
folders with many kinetics barriers. Yet we expect that the limits of applicability of the 
current theory should be flexible enough to describe a wide range of cases reasonably 
well. In figure [12] we compare the theory and the experiments for a 19 bps DNA 
sequence [4] that is not a faithful model of a two-state folder. The free energy landscape 
calculated for this molecule shows that the F and UP states are separated by two 
kinetic barriers [29]. Still the theory applied to such sequence agrees pretty well with 
the experiments. The extension of the current theory to more complex free energy 
landscapes as well as establishing limitations of the present theory remain as interesting 
open questions for future research. 
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Figure 12. (Wdis) for the stretching (circles) and releasing process (squares) 
plotted as a function of the loading rate in a 19 base pairs DNA sequence that was 
investigated [29] and with kinetics that deviates from perfect two-states behavior. 
The continuous (dashed) lines are the analytical predictions (|15p for the stretching 
(releasing) processes. The straight dotted line is the linear response regime ([20]). The 
parameters for the simplified rates that are extracted from hopping experiments in the 
passive mode are: = 9.53 nm, x^^ = 9.00 nm, A/ 1.0 pN and Kf"^ = 4.4 Hz. 
These parameters give fi — 0.02, Vl = 0.57 and ksubc = 2.5 Hz. 
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Appendix A. Distribution of the work and the hopping number in a 
two-state system 

We want to compute the distribution of probability of the work (P), and the hopping 
number ([7]), given by ([8]) and ([9]). We use the integral representation of the delta 
function, 6{x) = ^ dA exp(iAx), and introduce in (IHl) the following identity: 



I = Y[ — / d7''dm'' exp 



/ ^ N 



(A.l) 



After some manipulations, the distribution of any observable 6 (e.g. work or hopping 
number) can be written as: 



PNie) oc / dA n dT'dm'^ exp Nfg (w, A, {7'}, {m'} 

k=0 



(A.2) 
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where fg is a function that depends on the observable 6. We will use the notation /m = a 
and /w = b, for the work and the hopping number respectively. In the continuous limit 
the probability distribution ( ]A.2p . becomes a path integral, where the a and b functions 
read: 



+ 



1 



■^111/2 



(/max - /min) + / dsm{s)r{s) 





N 



ds {m{s) [27(5) 
1 rt 



+ 



C{S)] + d{s)} + log e^ k^ifmin) + e"^ k^ifn 



(A.3) 



e-^ fc^(/miy^.4) 



ds {m(s) [27(s) + e(s)] + ^(s)} + log 

The function r(s) is the rate of increasing the external field /, r(s) = and /min 
is the initial value of the field in the ramping protocol, k^ and k^ are the rates ([2]) 
corresponding to the transition from cr = — ltoo" = l and from o" = ltocr=— 1, 
respectively. The functions c(s), d{s), e{s) and g{s) are given by: 

c{s) = A:^(/(s))(e-2^(^) - 1) - A:_(/(s))(e2^(^) - 1) , 

d{s) = A;^(/(s))(e-2^W - 1) + A;_(/(s))(e2^(^) - 1) , 
e{s) = A;^(/(s))(e-2^('')+^/2 _ _ f^^^f^^^^^^2jis)+x/2 _ 

d{s) = A;^(/(s))(e-2^(^)+^/2 - 1) + k^{f{s)){e'^^'^+^/^ - 1) 

with boundary conditions ■y{t) = and m(0) = tanh(7(0) + /3a;m/min/2). Note that 
these boundary conditions break causality. In the large approximation, the integral 
given by flA.2l) can be estimated by using the saddle point technique. The saddle point 
equations, obtained by maximizing the a and b functions over the variables A, 7(5) and 
m(s), are given by: 



(A.5) 
(A.6) 
(A.7) 
(A.8) 
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where the dots mean the derivative with respect to the time s, and kr^^f), kuif) are 
given by /ct(/) = k-,{f) + k^{f), kuif) = k^{f) — k^{f). It can be shown [6] that the 



0, which gives 



most probable value for the observable 6*, 6'"'", can be obtained as ^| 
A"*" = 0. In the large A^ limit the most probable value and the average value coincide. 
The average work and hopping number read: 

C /max 
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(A.9) 
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where the functions mc^{f) and m{f) are given by: 
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Appendix B. Expansion of the work and the hopping number in the low 
loading rate regime 

For a system described by the folding and unfolding rates, k^{f) and k^{f), given in 
([2]), the functions /ct(/) and ku{f) read: 

k^if) = k^if) + k^if) = 2k,e-^^'^ coshx, (B.l) 

and 

kuU) = k^f) - kAf) = 2A;ce-^^^sinha:, (B.2) 



where kc is the folding or unfolding rate at the coexistence force 
to a dimensionless force x = '■■^"^ jf , and /i is defined as = ^ 



X corresponds 
-. Using these 

expressions we can write the average dissipated work and the average hopping number, 
([n]) and ([ED, as: 



with 



(W^is) = k^T 

F(— oo, x) = 
(M) = 



dxF(— oo, x) , 



dyXcq(y)e" 



1 

2f 



poo 

/ dx(-m^q(x) + l)e"^^'' cosh 

.J —oo 

/oo 
dx(e"^''^ sinhx)F(-oo, 
-oo 

where f is a dimensionless loading rate, given by f 



X 



(B.3) 
(B.4) 

(B.5) 



Y4^f, the function meq (defined in 
( |T3|) ) is given by mcq(x) = tanhx, and Xeq(a^) = '^"dx''^'' ~ cosL'^ x • Fiii^illy, the function 
is given by (p^y, x) = — Jy dz^^^ = Jy dz e~^^ cosh z. Since (j){y, x) is defined positive for 
all X > y, when r goes to zero (or f — > 0) e"'^^^'^-'/'' vanishes except in a; = y where = 0. 
Therefore, at the low loading rate regime, we can use a saddle point approximation and 
expand the integrand of F{—oo,x): 



F(— oo, x) 



dylXeqix) - Xcq(a;)(y - x) + 



Xeqix){y-XY 
oo " 2 

e ^ [l + -^-^(x-y)'-^4^(i/-x)3 



2f 



6r 
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X] 



j:2 



(t>" {x)Xoc,{x) Xcq(/) 



^x'ifW'ix) , x''{f) 



+ 



+ 0(f 



(B.6) 



(f)'{x)^ 4(/)'(x) 

where the prime means the derivative with respect to x. By introducing the previous 
expansion to (1B.4P and flB.51) we get: 



(M) 



The different coefficients of the expansion are given by: 



rfx — -3- = -(1 - sec(7r/i/2) 
-00 cosh X Z 



(B.7) 



(B.8) 



dxe ^'^^sech'^?/(/i + 3tanhx) = -— — /i^)7r csc(7r/i) , (B.9) 



cosh X cosh X 



+ 9tanh x + 4/itanhx — yU^ 



40 



-5 + - + 9/i^)7rsec(37r/i/2) 



= 



IT 



00 gM^ 

dx — - — = — sec(7ryu/2) 
-00 coshx 2 



7(/i) = 1/2 dxe '^^sech xtanhx(/i + Stanhx) 



48 



(9 - + /i^)7rsec(7r/i/2) 



1 /■°° sinhxe ^'^^ 
fix 



cosh^x ''cosh^x ~'~ 



+ 9tanh x + 4/itanhx — /i^ 



-l/3(/i — /i^)7r csc(7r/i). 



(B.IO) 

(B.ll) 
(B.12) 

(B.13) 
(B.14) 
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